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Abstract 

TJ ■ 
^ , We present exact results, as well as some illustrative Monte Carlo 

Q ' simulations, concerning a stochastic network with weighted connec- 

O I tions in which the fraction of nodes that are dynamically synchronized, 

p G [0, 1] , is a parameter. This allows one to describe from single-node 
kinetics {p — > 0) to simultaneous updating of all the variables at each 
^ ' time unit (p — ^ 1). An example of the former limit is the well-known 

tN I sequential updating of spins in kinetic magnetic models whereas the 

latter limit is common for updating complex cellular automata. The 
emergent behavior changes dramatically as p is varied. For small val- 
f^ ■ ues of p, we observe relaxation towards one of the attractors and a 

\^ I great sensibility to external stimuli and, for p > pc, itinerancy as in 

^P ■ heteroclinic paths among attractors; tuning p in this regime, the os- 

cillations with time may abruptly change from regular to chaotic and 
vice versa. We show how these observations, which may be relevant 
concerning computational strategies, closely resemble some actual sit- 
i-rt ' uations related to both searching and states of attention in the brain. 

^ ! PACS: 02.50.Ey; 05.45. Gg; 05.70.Ln; 87.18. Sn; 89.20.-a 
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1 Introduction and definition of basic model 



X 

^ ■ A dynamic network of many nodes connected by weighted communication 

lines models a great variety of situations in physics, biology, chemistry and 
sociology, and it has a wide range of technological applications as well; see, 
for instance, |^ HI El S El El IZ|- Examples of weighted networks are the 

'Presently at Institute for Adaptive and Neural Computation, School of Informatics, 
University of Edinburgh, EHl 2QL, UK. 



metabolic and food webs, which connect chains of different intensity, the In- 
ternet, the world wide web and other social networks, in which agents may 
interchange different amounts of information or money, the transport nets, 
whose connections differ in capacity, number of transits and/or passengers, 
spin glasses and reaction-diffusion systems, in which diffusion, local rear- 
rangements and reactions may vary the effective ionic interactions, and the 
immune system, the central nervous system and the brain, e.g., high-level 
functions in the latter case seem to rely on synaptic changes. 

A rather general feature in these systems is that the nodes are not fully 
synchronized when performing a given task — which may be either a mat- 
ter of economy or else, perhaps more frequently, a necessary condition for 
efficient performance. Even though this is as evident as the fact that links 
are seldom homogeneous, studies of partly synchronized networks are rare. 
Furthermore, the relevant literature is dispersed, as it was generated in vari- 
ous distant fields, and a broad coherent description is lacking. In particular, 
related studies often disregard an important general property, namely, that 
the systems of interest are out of equilibrium. That is, they cannot settle 
down into an equilibrium state but the network typically keeps wandering 
in a complex space of fixed points or, in one of the simplest cases, it reaches 
a nonequilibrium steady state whose nature depends on dynamic details |2]. 
This results in a complex landscape of emergent properties whose relation 
with the network details is poorly understood. In this paper, as a new effort 
aimed at methodizing somewhat the picture, we present some related ex- 
act results, together with illustrative Monte Carlo simulations, which apply 
to a rather general class of partly-synchronized heterogeneous or weighted 
networks. It follows, as a first application, examples of itinerancy and con- 
structive chaos which mimic recent experimental observations. 

Consider a network, with a processor, neuron, spin or, simply, variable 
at each node, and define the sets of node activities, a = {iTj} , and com- 
munication line weights, w = {wij} , where i,j = 1,...,N. Each node is 
acted on by a local field hi (a, w) which is induced by the weighted action 
of the other, N — 1 nodes. We also define an additional, operational set of 
binary indexes, x = {xi = or 1}. Time evolution proceeds according to 
a generalized cellular-automaton strategy. That is, at each time unit, one 
simultaneously modifies the activity of n variables, 1 ^ n ^ N, and the 
probability of the network state evolves in discrete time, t, according to 

Pt+,{a) = Y,RW^'^)PtW) (1) 

a 

with the (microscopic) transition rate: 

R{a^a')=Y,Pn{^) n V>n{^^^a';) J] 5,^,,,. (2) 

X {i\x^=l} {i\xi=0} 



Here, (pn {(Ji ^ a[) = ip {ui -^ cr'^^) 1 + (6^'__^- - 1 j 6n,i is the elementary 
local rate, if is an arbitrary function of (3aihi where (3 is an inverse "temper- 
ature" — i.e., a parameter which controls the stochasticity of the process — 
and, for any set of n sites chosen at random, one has that 

;,„(x)=(^) \{y^x.-n\. (3) 

This is the natural generalization of two familiar cases: The Glauber se- 
quential updating J2j follows for n = 1 , so that it is obtained macroscopically 
in the limit of the minimal dynamic perturbation or p = n/N — > 0, while the 
above reduces to the Little parallel updating J8^, "9" for n = N, i.e., as p — > 1. 
One may think of many situations whose understanding may benefit from 
studying the crossover between these two situations. For example, assuming 
a cell which is stimulated only in the presence of a neuromodulator such as 
dopamine, the parameter n will correspond to the number of neurons that 
are modulated each cycle. That is, the other N — n neurons receive no input 
but maintain memory of the previous state, which has been claimed to be 
at the basis of working memories ^^ 



2 Some explicit realizations 

For simplicity, and also to have well defined references, we shall represent 
nodes in the following as binary variables, Ci = ±1, while Wij € M, and con- 
sider local rates ip {ai -^ a[ = —ai) = ^ [1 — (Tj tanh {f3hi)\ , which is rather 
customary as a case that satisfies detailed balance J2j. Notice, however, that, 
in general, detailed balance is not fulfilled by our basic equation (^ nor by 
the superposition ((2j as far as n > 1. Consequently, in general, our system 
cannot be described by Gibbs ensemble theory. We shall further assume 
that the fields satisfy 

hi (cr, w) = /i [vr (cr) , ii] . (4) 

We are assuming here a set of M given patterns, namely, different realiza- 
tions of the network set of activities, to be denoted as ^ = {^j} with ^, = 
{^f = ±1; ;U = 1, . . . , M} , and vr = {vr^ (cr)} , where the product vr'^ [a] = 
A^""*^ ^^ i^cji measures the overlap of the current state with pattern pL. For 
A^ ^ oo and finite M, i.e., in the hmit a = M/N -^ 0, from (HJ)-©, the 
mesoscopic time-evolution equation 

7rf_,i {a) = pN-' Yl C tanh {(3h, [nt (a) , ^i]} + (1 - p) < (^) (5) 

i 

follows for any //. The details of the derivation, as well as some possible 
generalizations of this result, will be published elsewhere [TT] . 



One of the simplest realizations of the above is the Hopfield network 
J12lll3l[n| . In this case, the communication line weights are heterogeneous 
but fixed according to the Hebb (learning) prescription Wij = N~^ ^ Ct^j^ 
and the local fields are hi (a, w) = 'Ylj^i'^^ij^i- These choices satisfy con- 
dition Q which also holds for other non-linear learning rules; in any case, 
one may easily generalize © to include other interesting cases (see, for in- 
stance, [ini) which do not precisely conform to ^. The original Hopfield 
model evolves by Glauber processes, namely, by attempting a single vari- 
able change, ai — > — Cj, at each unit time — e.g., the Monte Carlo step — 
with probability ip {j3aihi) . The symmetry Wij = Wji and detailed balance 
then guarantee asymptotic convergence to equilibrium, i.e., Pt-^oo (o") oc 
exp(/3X]./iicrj). 

Computational efficiency has sometimes motivated to induce time evo- 
lution of the Hopfield network by the Little strategy, i.e., p ^ 1 in our 
formulation. This is known to drive the system to a full nonequilihrium 
situation, in general ^Hl- The local rule and other details of dynamics are 
then essential in determining the emergent behavior. Not only the time 
evolution may vary but also the nature of the resulting asymptotic state, 
perhaps including morphology, phase diagram, universality class, etc.; see 
Refs.pi [T71ll8j for some outstanding examples of this assertion. 

For completeness, we mention that the Hopfield network, i.e., p — s- will 
also correspond, in general, to a nonequilibrium situation when implemented 
(unlike in the original proposal J2]) with asymmetric or time-evolving 
weights or with a dynamic rule lacking detailed balance. There is some 
chance that an effective Hamiltonian ^], such that Pt^oo (c) oc exp (i/eff) , 
can then be defined, however. When this is the case, one may often apply 
equilibrium methods, with the result of relatively simple emergent properties 

Concerning our proposal ©, we first mention that, assuming fields that 
conform to the Hebb prescription with static weights, the Hopfield property 
of associative memory is recovered for /? — * 0, as expected. That is, for high 
enough (5 (which means below certain stochasticity) the patterns ^ may 
be attractors of dynamics. Consequently, an initial state resembling one 
of the patterns, e.g., a degraded picture will converge towards the original 
one, which mimics simple recognition J13l I14j . We checked too that, in 
agreement with some previous indications [22j, implementing the Hopfield- 
Hebb network with p > produces the behavior that characterizes the 
familiar case p — > 0, including associative memory, even though equilibrium 
is precluded, e.g., in general, no effective Hamiltonian is predicted to exist 
for any p > [TBI. Excluding these Hopfield-Hebb versions, our model 
exhibits a complex behavior which depends dramatically on the value of p. 
This is a consequence of changes with p in the stability associated with (|5)). 
as we show next. 



3 Some main results 

The local fields may be determined according to various criteria, depending 
on the specific application of interest. That is, one may investigate the 
consequences of equation ^ and associated stability for different relations 
between the fields and the weights Wij and between these and other network 
properties. 

We shall be mostly concerned in the rest of this paper with a specific 
neural automaton as a working example. In this case, the above assumption 
of static line weights happens to be rather unrealistic. As a matter of fact, 
one is eager to admit, concerning different contexts, that the communica- 
tion line weights may change with the nodes activity, and even that they 
may loose some competence after a time interval of heavy work. This seems 
confirmed in the case of the brain where the transmission of information 
and many computations are strongly correlated with activity-induced fast 
fluctuations of the synaptic intensities, namely, our Wjj's [2S1I12- Further- 
more, assuming the experimental observation that synaptic changes may 
induce depression ^^ seems to have important consequences PBI 071 1^ . 
That is, a repeated presynaptic activation may decrease the neurotransmit- 
ter release, which will depress the postsynaptic response and, in turn, affect 
noticeably the system behavior. For concreteness, motivated by these facts, 
we shall adopt here the proposal in Refs.jSDEHl- This amounts to assume a 
simple generalization of the Hebb prescription which is in accordance with 
condition (JU, namely, 

M 



where g (vr) = (1 + a) X^„ tt^ (o") depends on the set of stored patterns. 
The Hopfield case discussed above is recovered for $ = — 1, while other 
values of this parameter correspond to fluctuations which induce depression 
of synapses by a factor — $ on the average. 

The choice © happens to importantly modify the network behavior, 
even for a single stored pattern, M = 1. The stationary, t ^ oo solution of 
is then tToo = F {tToo] P, ^) with 

F {tt; p, $) = ptanh {/37r [l - (1 + $) tt^] } + (1 - />) ^, (7) 

and local stability requires that \dF {tt; p,^) /dn] < 1. The fixed point is 
therefore tToo = tanh {PtToo [l — (1 + $) vr^] } , independent of p, while sta- 
bility crucially depends on p. The limiting condition dF (vr; p, $) /dirl^ = 1 
corresponds to a steady-state bifurcation. This implies for tToo = that 
P < Pc = ^, independent of both p and <&. Non-trivial solutions tToo 7^ 
in this case require that $ > —4/3, which includes the Hopfield case. The 
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Figure 1: Evidence for critical transitions from regular to chaotic behavior 
as the synchronization parameter p = n/N is varied. Top graph: Monte 
Carlo results for depressing fluctuations with <l> = 1/2. This shows the de- 
pendence on p of the stationary overlap between the activity and a single 
(randomly generated) pattern for N = 3600 variables, and inverse "tem- 
perature" (3 = 20. The dashed line is for the standard Hopfield-Hebb case, 
$ = —1. Bottom graph: The dependence on p of the Lyapunov exponent, as 
obtained analytically from the saddle-point solution, for the same case as 
above (solid irregular line) and for $ = — 1 (dashed line). This graph also 
shows the value p = pc, i.e., the minimum degree of synchronization needed 
to observe chaotic behavior, and the line A = for reference purposses. 
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Figure 2: The chaotic behavior in figure ^ occurs also as the number 
of patterns is increased. This graph shows the dependence on the syn- 
chronization parameter p of the steady-state value of the order parameter 
q (tt) = (1 + a) ^ vr^ (a) . The behavior shown here — which follows indis- 
tinctly from the analytical solution or from Monte Carlo simulations — is 
for M = 20 stored (randomly generated) patterns, A'^ = 3600, /3 = 20 and 
$ = 1/2. The dashed, horizontal line g = 1 is for the Hopfield case, <1> = — 1; 
this illustrates that, except for scaling of the relaxation time, the value of p 
is then irrelevant. 



other limiting condition dF (tt; p,^) /dnl^ = —1 corresponds to a period 
doubling bifurcation. It follows from this that local stability requires p < pc 
with 

p, = 2{3P7rl[{^ + l)-{l + <5)7rl]-(3 + iy\ (8) 



It is to be remarked that this condition cannot be fulfilled in the Hopfield, 
$ = — 1 case, for which one obtains from ^ the nonsense solution pc > 2. 
The resulting behavior is illustrated in figure ^ This shows, for M = 1, 
the onset of chaos at p = pc in the saddle-point map ^ and, accurately 
fitting this, in Monte Carlo simulations. The behavior shown in the top 
graph of figure n which is for $ = g, is likely to characterize any $ 7^ —1 as 
well. This behavior does not occur for the singular Hopfield case with static 
synapses, for which the stability of tt is independent of p. The bottom graph 



in figure ^ illustrates that one has for p > pc regimes of regular oscillations 
among the attractors (i.e., the given pattern and its "negative" in this case 
with M = 1) which are eventually interrupted as one varies p, even slightly, 
by eventual chaotic jumping. 

The critical value of the synchronization parameter for the emergence 
of chaos, due to local instabilities around the steady vr solution may be 
estimated in figure ^ as pc = 0.137 for M = 1. This is precisely the value 
that one obtains from equation for /3 = 20, tt = 0.788 and ^ = 2- 

Figure I^J confirms that this behavior occurs also for M >> 1 stored 
patterns, and figure 01 shows the detail during the stationary part of typ- 
ical runs for representative values of p. In particular, figure |31 illustrates 
qualitatively-different types of time series our model exhibits, namely, from 
bottom to top: {i) convergence towards one of the attractors — in fact, to 
one of the antipatterns — for p < p^, (ii) chaos, i.e., fully irregular behav- 
ior with a positive Lyapunov exponent for p > p^, (in) a perfectly regular 
oscillation between one of the attractors and its negative for p > pc, (iv) 
onset of chaotic oscillations as p is increased somewhat; and (v) very rapid 
and completely ordered and periodic oscillations between one pattern and 
its antipattern when all the nodes evolve synchronized with each other at 
each time step. The cases (ii) and, less markedly, (iv) are nice examples 
of instability-induced switching phenomena. That is, as suggested also in 
experiments on biological systems (see next section), the network describes 
heteroclinic paths among the stored patterns, remaining for different time 
intervals in the neighborhood of different attractors, the choice of attractor 
being at random. 

4 Discussion 

In summary, we report in this paper on a class of homogeneous or weighted 
networks in which the density, p, or the number of variables that are syn- 
chronously updated at a time may be varied. This is remotely related to 
block-dynamics, block-sequential, and associated algorithms 123120] j which 
aim at more efficient computations, and it generalizes some previous propos- 
als 31, 22, 32j . We describe in detail the behavior of a particular realization 
of the class, namely, a neural automaton which is motivated by recent neuro- 
biological experiments and related theoretical analysis. Different realizations 
of the class correspond to different choices of the local fields /i (vr, ^) that act 
upon the stochastic variables at the (neural) nodes. For certain values of 
these fields, which amount to fix the (synaptic) connections at some constant 
values, e.g., according to the Hebb prescription, one recovers the equilibrium 
Hopfield network. The parameter p is then irrelevant concerning most of the 
system properties. Our model also admits simple extensions, corresponding 
to other values of the local fields, that one may characterize by a complex 
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Figure 3: The overlap as a function of time (in units of n MC trials) after 
a transient time t = 1920n, for N = 1600, /3 = 20, $ = 0.4 and M = 3 
uncorrelated patterns. It follows in this case that pc = 0.085. Different 
graphs are for increasing values of p from bottom to top, namely, for p = 
0.08, 0.50, 0.65, 0.92 and 1.00, respectively. 



effective temperature [2|l21j. 

The Hopfield picture has severe Umitations concerning its practical use- 
fulness fll|, and some of these limitations may be overcome by producing a 
full nonequilibrium condition. It is sensible to expect that p will then trans- 
form into a relevant parameter. This is, in fact, the situation in [SJ which 
deals with a modification of the Hebb prescription which includes multiple 
interactions, random dilution and a Gaussian noise. This implies a choice for 
the fields that even precludes the existence of an effective temperature, and 
chaotic neural activity ensues. Our biologically motivated choice, namely, 
Hopfield local fields with the simple prescription Q, which is interpreted 
as a consequence of depressing synaptic fluctuations, induces a full nonequi- 
librium condition — even for p — > 0. In this limit, the system was recently 
shown to exhibit enhancement of the network sensitivity to external stimuli 
|21j . This happens to be a feature of the system for any p. This interesting 
behavior, which we illustrate in figure|ll corresponds to a type of instability 
which is known to occur in nature, as discussed below. This is associated 
here to a modification of the topology of the space of fixed points due to the 
action of the involved ^-controlled noise. 

Figure 0] is a model remake of experiments on the odor response of the 
(projection) neurons in the locust antennal lobe [H3]- Our simulation il- 
lustrates two time series (with different colors) for the mean firing rate, 
m = 2^ J2i (1 + Ci) 1 in a system with six stored patterns which is exposed 
to two different stimuli of the same intensity and duration (between 3000 
and 4000 time steps — each step corresponding here to n trials). Each pat- 
tern consists of a string of N binary variables; three of them are generated at 
random with, respectively, 40%, 50% and 60% of the variables set equal to 
1 (the rest are set equal to —1), while the other three have the Is at the first 
70%, 50% and 20% positions in the string, respectively. The bottom graph 
shows with horizontal lines the baseline activity without stimulus (BS) and 
the network activity level in the presence of the stimulus /U = 1 (SAl) and 
/i = 2 (SA2), which correspond to two of the random stored patterns. 

The conclusion is that the stimulus destabilizes the system activity as 
in the laboratory experiments. Note, however, that this occurs for p < pc, 
i.e., in the absence of chaotic behavior. As a matter of fact, the behavior in 
figure 0] will also be exhibited in the limit p — > which does not show any 
irregular behavior |21j . 

On the other hand, the suggestion that fiuctuating connections may 
induce fractal or strange attractors as far as p > |32[ I28j is confirmed 
here. As illustrated in figure 01 our system may exhibit both static and 
kind of dynamic associative memory in this case. That is, the network state 
either will go to one of the attractors (corresponding to one of the given 
patterns stored in the connecting synapses) or else, for p > pc, will forever 
remain visiting several or perhaps all the possible attractors. Furthermore, 
the inspection rounds may abruptly become irregular and even chaotic as 
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Figure 4: Itinerancy induced by an external stimulus. This shows the mean 
firing rate as a function of time (bottom graph) and as a phase space three- 
dimensional trajectory (top graph) when the system is perturbed as ex- 
plained in the main text. The situation here closely resembles the experi- 
mental observation concerning odor responses in figures 2 and 4 in Ref. jliSj . 
The graphs here correspond to the Monte Carlo simulation of our system 
with N = 1600, T = 0.25, # = 0.45, p = 3/64 < p^, and six stored patterns. 
The time unit corresponds to n trials. Performing the top graph required 
a standard false-neighbor method which indicated an embedding dimension 
j34j of 5. The involved time delay is r = 20n MC trials. 
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the density of synchronized neurons varies shghtly. It follows, in particular, 
that the most interesting, oscillatory behavior requires synchronization of 
a minimum of variables, and also that occurring chaotic jumps between 
attractors requires some careful tuning of p. In fact, as illustrated in the 
bottom graph of figure once the critical condition /) > pc is fulfilled a 
complex situation ensues where it seems difficult to predict the resulting 
behavior for slight variations of p. 

The chaotic behavior is further illustrated in figure El This shows tra- 
jectories among the three stored patterns, namely, ^^, ^^ and ^^, .^'^ = 
{^f ; i = 1, . . . , N} . These are designed, respectively, as a homogeneous string 
of Is, a string with the first 50% positions set to 1 and the rest to —1, and as 
a string with only the first 20% positions set to 1. We observe many jumps 
between two close (more correlated) patterns and, eventually, a jump to the 
most distant pattern. 

It seems sensible to comment on this behavior at the light of the growing 
evidence of chaotic behavior in the nervous system |351 I36j . We have shown 
(e.g., figure EJ that chaos is not needed to have efficient adaptation to a 
changing environment. However, one may argue |SS1) for instance, that the 
instability inherent to chaotic motions facilitates this and, in particular, the 
system ability to move to any pattern at any time. This behavior, which 
has been described for the activity of the olfactory bulb and other cases, is 
nicely illustrated in figures El and |S1 Our network thus mimics the observed 
correlation between chaotic neuron activity and states of attention in the 
brain, as well as other cases of constructive chaos in biology P7l 051 OHlUnj . 

Chaos has been reported in other interesting networks (e.g., Ref. |41j ) 
but, to our knowledge, never in such a general setting as here. As a matter 
of fact, the present model allows for some natural generalizations J^ and, 
in particular, suggests a great interest for a more detailed study of the ap- 
parently unpredictable behavior it exhibits for p > pc- This teaches us that 
varying /> is a simple method to control chaos in networks, and that this 
may also help in determining efficient computation strategies |421 H^ . Con- 
cerning the latter, the model behavior may be relevant, for instance, when 
judging on the best procedure for specific data mining and for the control of 
different activities on a multiprocessor system |44j , and deciding on whether 
to implement sequential or parallel programming in some extreme cases [IS] . 
Our findings here may also help one in interpreting recent experimental evi- 
dence of parallel processing in laminar neocortex microcircuits |461l47j . That 
is, a comparison between the model behavior and experimental results may 
shed light on the dynamics of these circuits and their mutual interactions. 

We thank I. Erchova, P.L. Garrido and H.J. Kappen for very useful com- 
ments. This work was financed by FEDER, MEyC and JA under projects 
FIS2005-00791 and FQM-165. JMC also acknowledges financial support 
from the EPSRC-funded COLAMN project Ref. EP/CO 10841/1. 
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Figure 5: Instability and switching among the attractors as in a state of 
attention induced by chaos. The mean firing rate as a function of time 
(bottom graph) and as a trajectory in a three-dimensional phase space (top 
graph) correspond here to a simulation with A^ = 1600, T = 0.006, ^ = 2, 
p = 123/320 > pc in a chaotic window, and three stored patterns denoted 
^'^. The top graph involves an embedded dimension of 5 and a time delay 
r = 5n MC trials. 
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